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SUMMARY 

In the present study, a method is developed to incorporate neural network models for 
material response into nonlinear elastic truss analysis. Different feedforward network configura- 
tions are developed to assess the accuracy of neural network modeling of nonlinear material re- 
sponse. In addition to this, a scheme based upon linear interpolation for material data, is also 
implemented for comparison purposes. 

It is found that the neural network approach can yield very accurate results if used with 
care. For the type of problems under consideration, it offers a viable alternative to other mate- 
rial modeling methods. 


INTRODUCTION 

It has been an ongoing effort to create machines which are capable of exhibiting intelligent 
behavior. The research in the Artificial Intelligence (Al) area is directed to achieve this goal. 
The traditional AI based approaches lead to the. development of Expert Systems. They are use- 
ful in cases where a given problem can be specified in the form of well defined rules. By using 
symbolic logic useful inferences can be drawn from the rules data base by following standard 
search techniques. However, this approach was not very successful in pattern recognition tasks 
where the available information is noisy or incomplete. 

Neural networks (NN), inspired by the research in cognitive and biological sciences in the 
functioning of the brain have provided an alternative approach to the solution of pattern recog- 
nition tasks, such as text to speech synthesis (ref. 1), image compression and processing (ref. 2), 
and nonlinear signal processing (ref. 3). Several neural network models have been suggested. 
Hopfield (ref. 4) was successful in applying network approach for a class of optimization prob- 
lems. One of the most popular neural network models is based upon the studies of Rumelhart, 
Hinton, and Williams (ref. 5). It is a multi-layered feedforward network, in which learning is 
accomplished by backpropagation algorithm. It has been used extensively in solving a wide 
variety of problems. The computational NN models resemble the biological model of neurons. 
However, this resemblance is not very close and to avoid misunderstanings, they are called Arti- 
ficial Neural Nets (ANN). 



The application of feedforward networks based upon backpropagation algorithm in Com- 
putational Structural Technology (CST) is relatively new in its origin. Rehak et al. (ref. 6) 
developed NN models for simulating the dynamic behavior of structures. Troudet and Merrill 
(ref. 7) adopted network methodology for estimating fatigue life of structural components. 

Berke and Hajela (ref. 8) used ANN for structural analysis and optimization of trusses. Their 
use in plate and shell analysis is reported in reference 9. They have shown considerable promise 
in material modeling. Jain et al. (ref. used it to model the tri-axial behavior of soils. 
Ghaboussi et al. (ref. ll) have reported the modeling of nonlinear behavior of concrete. 

It was suggested in references 8 and 11 that the trained neural networks can be incor- 
porated into existing structural analysis programs. The use of nonlinear analysis programs 
require an accurate description of material behavior. With the increased complexity in modeling 
material behavior, it is becoming necessary to look for new approaches to represent it in a form 
which is computationally efficient and can easily be added to the existing stress analysis pro- 
grams. The use of ANN seems to be particularly appealing for this type of nonlinear materials 
modeling. It allows to capture the material response by training an appropriately configured 
network for given material data. Once the network is trained for the desired accuracy a small 
data file containing the weights of connections and network biases is saved. It can be used later 
on for eliciting proper material response such as stresses for known strains or stress increments 
for given strain increments. The next step would be to incorporate this trained NN into a stress 
analysis program. 


OBJECTIVE OF THE STUDY 

The present study is conducted to explore the possibility of training feedforward network 
for known material data and then incorporate it into a structural analysis program considering 
material nonlinearity. For this purpose, nonlinear elastic analysis of trusses is chosen. The . 
material behavior is assumed to be known in the form of equations so that comparison between 
the actual material behavior and the one predicted by neural nets is possible for the evaluation 
of the effectiveness of the neural network approach. Different trusses are used for analysis to 
allow comparison between the different approaches. ' • 


NONLINEAR ELASTIC ANALYSIS OF TRUSSES 


A stiffness based matrix formulation (ref. 12) is used for the analysis of trusses, 
equilibrium equations for a truss can be written as: 


The joint 


[K] {u} = {f} 


( 1 ) 


where (K) is overall assembled stiffness matrix of truss, {u} and {f} represent the joint displace- 
ment vector and joint force vector, respectively, The material behavior is given by the following 
equation (ref. 13): 
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(7 = Eq(s — 5e^) for « > 0 

<7 = E(j(e + 5«*) for e < 0 

where Eq = 200 units 

For the equations dimensionally consistent units can be chosen. Due to nonlinear material 
behavior in equation (2) the stiffness matrix in equation (1) is a function of displacements {u}, 
and has to be solved in an iterative manner. The initial stiffness method as suggested in refer- 
ence 13 was used. This method saves the updating of the stiffness matrix at each iteration. The 
stiffness matrix formulated for the linear elastic case can be used for each iteration. This 
method is more stable in comparison to the tangent stiffness method which requires updating of 
the stiffness matrix at the beginning of each iteration. However, it' suffers from the slow conver- 
gence rate at loads near maximum loads. 

The total load is applied in n prescribed steps. The equations for the p‘'’ load step and 
the i*** iteration are: 

|K| (au|'} = {r,} (’) 

where 

1 1 , , 

W = (f”) - (t-il 


The vector represents the applied joint forces for the p*^ load step. 
change in the joint displacement vector for the i*** iteration for the load step p. {Rj} is a resi- 
dual force vector showing the error in the joint equilibrium due to the force vector {fj.x) com- 
puted from the forces in the members of the truss. The displacements for the i+1 iteration are 
updated by the following equation: 


k.. } = kl + H 

For the k*** member of the truss the elongations are calculated as follows: 




cos V 





Sin t; 


( 5 ) 


( 6 ) 


1 and m are the end joints of the member k. The U| and are the x-displacements 
of joints 1 and m, respectively. Similarly v’s are the joint displacements along the y- 
direction. v is the slope of the member with respect to the positive x-axis. The strains in 
each member of the truss are computed by: 
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k = 1,2 . . . , S 


( 7 ) 






Here 1|^ is the length of the mennber and s is the total number of members in the 
truss. The stresses in each member of the truss can now be computed by using equation (2) or 
by the trained neural network. The forces in each member are obtained from these stresses. 

The member forces are transformed to obtain the equivalent joint forces to assemble the new (f.} 
vector. The residual force vector for the i-^ 1 iteration will be: 


(R,.,) = W- W, 

The new joint equilibrium equations are: 

|R| = {Ri+.| 


By using Gauss-Jordan method the incremental displacements are calculated and the pro- 
cedure can be repeated as described earlier. To stop the iterative process an error norm given by 
the following equation is calculated: 


. (> 0 ) 

q=l 


where S is the rms error, and r is the total number of nonzero joint displacements in the 
truss. When the calculated value of rms error S is less than the prescribed tolerance the 
iteration process is stopped and the values of the joint displacements, member forces, stresses 
and strains are printed. The applied joint loads are incremented for the next load step p+1. 
This procedure is repeated until all the load steps are completed. 



ARTIFICIAL NEURAL NETWORK MATERIAL MODELING 

Figure 1 shows the neural network configuration. It has one processing element (PE) in 
the input layer with strain as the input. The output layer consists of one PE providing the 
value of stress. The processing elements in the middle layer also, known as hidden layer, are 
varied from 5 to 15 to find an appropriate network configuration which predicts stresses for a 
given strain with the smallest error. The computer program NETS (ref. 14) was used for all the 
network training. In the program the back propagation algorithm was implemented at Lyndon 
B. Johnson Space Flight Center of NASA. 

For incorporating the neural network model of material behavior in the nonlinear truss 
analysis program, two small functions, “init” and ‘‘propagate,’’ were written in C language. The 
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first one initializes the net while the second one propagates the given input strain to get the 
corresponding stress. The output Oj of an PE can be obtained as follows: 


Oi = ^ (11) 

1 + e 

where Wy is the weight of the connection between PE i and PE j. Ij is the input from the 
j‘** PE and bj is the bias value in 


"" E ^ij*j + 

j=i 


b: 


( 12 ) 


for the i‘^ PE. 


RESULTS AND DISCUSSIONS 

To assess the accuracy and to choose an appropriate network configuration for the non 
linear truss analysis several cases listed below were selected for numerical experimentation. 


case 1 

1-5-1.13 network 

case 2 

1-10-1.13 network 

case 3 

1-15-1.13 network 

case 4 

1-5-1.19 network 

case 5 

1-10-1.19 network 


In these cases the first number denotes the number of input units, which is always one. 

The second number represents the number of hidden units and it varies from 5 to 15. The third 
number which is one in all the cases, is the number of output units. The last number after the 
period is the total number of input-output pairs used for network training. These pairs arc 
obtained from equation (2). All the training data was scaled between 0 and 1 due to the restric- 
tion placed by the backpropagation algorithm implemented in the NETS program. Scaling between 
0.1 and 0.9 is also customary. All the networks are trained with a maximum error not exceeding 
1.8 percent and rms error less than 1 percent. After the training the files containing weights and 
biases are saved for each of the network to assess the accuracy of all the neural networks. 

The input strains used for training are augmented by additional values of strains from the 
stress-strain equation (2) to propagate the data. The predicted values for stresses from neural 
nets for these strains are plotted along with the actual stress-strain curves obtained from equa- 
tion (2). Figure 2 contains the plots for cases 1 to 3. It shows good prediction capability of all 
the cases with case 3 being closest to the actual stress strain curve. Similarly in figure 3, data 
from cases 4 and 5 is plotted. Both cases are in good agreement with the known results. Fig- 
ure 4 shows the comparison between cases 3 and 4. These two models are very close to the cho- 
sen stress-strain curve for the study. It is difficult to select the best case from these plots. 
Therefore, for a closer look at the accuracy of the results, percent error in neural network inter- 
polations versus strains are plotted on figures 5 to 7. It can be seen from these figures that the 
percent error is within d:3 percent when the strains used for tridning are also used for the predic- 
tion of stresses. For other value of strains, these errors could be significant. Especially at 
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the two end points of the stress-strain curve where strain values are nearly ±0.2. However, in 
nonlinear analysis, truss members do not attain these high values of strains. The other location 
where errors in predictions are significant, is near the strain level zero. It should be noted that 
at these strain levels the actual stress is approaching zero. Any small variation in the prediction 
by Neural net causes a large relative percent error because in calculating the percent error, the 
difference between the actual and the predicted stress is divided by a stress value which is small 
in magnitude. This artificially magnifies the magnitude of the error. This shows that neural 
network predictions although very accurate, could be in error at few points and a careful check- 
ing is necessary before selecting an appropriate network configuration for materials modeling. 

Figure 8 shows four truss geometries with dimensions and applied loading used in this 
study. For all these trusses a uniform cross section area of 1 unit magnitude is assumed. 

Manual calculations are performed for Truss! and Trus82. The initial stiffness method is imple- 
mented in a computer program written in C language to perform tlie nonlinear elastic truss 
analysis. For both cases the nonlinear stress-strain function given by equation (2) is used. 

These results for load and load point displacements are plotted on figures 9 and 10. For both of 
the trusses the results from the computer program and manual calculations are in close agree- 
ment. It shows that the initial stiffness method with incremental solution strategy can be used 
for nonlinear analysis purposes. In addition to these calculations, further calculations are done 
by dropping the nonlinear term from the equation (2). This results in a linear elastic material. 
The incremental solution leads to a straight line response for both of the trusses. This serves as 
a further verification of the computer program. In addition to this, it can also be seen from fig- 
ures 9 and 10 that there is significant nonlinearity in the responses of the trusses. The initial 
stiffness method has been able to capture this nonlinearity without any instability and errors. 

The computer program was slightly modified to include functions “init” and “propagate.” 
This allows to obtain the nonlinear stress-strain material data from the trained neural networks. 
The Trussl is analyzed by this program for cases 1 to 5. For all calculations 10 load steps and a 
tolerance of 0.005 are used. The results for applied load and load point displacements for all 
these five case are shown on figures 11 and 12. Except for case 1 all other cases show fairly 
good agreement with the manual calculations. It can be concluded from these figures that 1-5-1,19 
net produces the best results. It also leads to the conclusion that use of more input-output 
pairs for training the network provide better accuracy. For this problem due to availability of 
assumed stress-strain function any number of input-output pairs can be generated for network 
training. However, most of the time the material data are available only at discrete points. 
Therefore, computer program was slightly changed so that it can use material data supplied in 
form of a table. This table was created using the function given by the equation (2). For inter- 
mediate points, a linear interpolation scheme was implemented in the computer program. This 
case is indicated as linear interpolation on the plots. It more accurately emulates the existing 
nonlinear analysis programs in which material data is provided at discrete points. The results 
for cases 3 and 4 and from the linear interpolation scheme are shown on figure 13 for Trussl. 

The results from case 4 and linear interpolation scheme are very close to exact results. Case 3 
was chosen because it had the smallest maximum error of 0.0123 and rms error of 0.0057 among 
all other cases after training the network. However these plots show that this network does not 
produce the best results for Trussl. This particular network was trained for 23 604 cycles. It is 
known that overtraining usually reduces the generalization capability of network models. Over- 
all, all the models used, in the study provide adequate approximate solutions. It is encouraging 
that the errors noted earlier seems to average out when neural nets are used for material mod- 
eling. In situations where material data is available only at few points from experiments, neural 
net approximations will be able to provide results within reasonable accuracy. 
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For Trussl a load of 9.6 units is applied in 10 increments with a tolerance of 0.005. A time 
function is used to evaluate the total execution time for all the five cases. These results are 
shown on figure 14 along with the case when the exact stress-strain function is used for material 
modeling in the computer program. It can be seen that cases 4 and 5 take more time when com- 
pared with the similar networks of cases 2 and 3, respectively, that have identical number of hid- 
den units. This difference is due to a higher number of iterations needed for convergence. This 
also points to a situation in which the best neural net model may not be fastest although it has 
the smallest number of hidden units. 

Similar calculations are performed for TruBs2 and shown on figure 15. Only cases 3 and 4 
are used for neural net modeling. Once again the best results for applied load and load point 
displacements are produced by case 4 when compared with the exact results from manual calcu- 
lations. For this truss the neural net model predicts better results than the linear interpolation 
scheme. Figures 16 and 17 show the results for applied load and load point displacements for 
Truss3 and Truss4. For both cases it was not possible to perform a manual computation. 
Therefore, the results from the initial stiffness program using the stress-strain function given by 
equation (2), are considered as the exact solutions. They are also plotted on these figures for 
comparison purposes. For both cases 1-5-1.19 net produces extremely accurate results. They are 
very close to the results from initial stiffness method. The linear interpolation scheme in both 
cases fails to provide accurate solutions, fn this study the stress-strain function used for 
material response is a second order parabola. The linear interpolation scheme was not able to 
approximate it closely. For material behavior with sharper gradients than a parabola this 
approximation scheme will further deteriorate. However, as mentioned earlier, this is the most 
commonly used scheme in the existing general purpose nonlinear finite element analysis pro- 
grams. These results show that it is prone to errors. It also shows that if neural network 
modeling is used carefully extremely accurate results can be obtained. Even in cases where the 
model is not chosen carefully, results of reasonable accuracy are attainable. It is anticipated 
that for materials with responses more complicated than a parabolic model, linear interpolation 
scheme should lead to larger errors. In such cases neural network material modeling can effec- 
tively be used in stress analysis problems. 

To further investigate the convergence characteristics of all these schemes, maximum load 
calculations are done for all four trusses. For manual calculations maximum load is obtained by 
choosing the peak points of the load-displacement plots. For initial stiffness method the peak 
load is obtained by incrementing the applied loads till the solutions fail to converge. The 
unloading part of the load displacement curve can not be calculated from this implementation of 
initial stiffness method due to incremental loading control. Table I shows that for first three 
trusses, neural network is very close to exact maximum loads. The same can be interpreted 
from figure 18. This is an indication that neural net material modeling does not appreciably 
change the convergence characteristics of initial stiffness method. 

The maximum displacements were calculated for applied load levels of 9.6, 20.5, 13.5, 
and 12.8 for the trusses by all the suggested schemes. The numerical values are shown in 
table II and the results are on chart 19. Neural network models compare favorably with exact 
solutions. 

For the previous cases the total execution times are also obtained. They are listed in 
table III. They are also shown on figure 20. For the first three trusses the time taken by the two 
neural network models and the linear interpolation method are comparable. However, this trend 
breaks down for the Truss4. In that case neural net provides accurate solutions but takes more 
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tim6 to converge to the results as compared to the linear interpolation scheme. These arc only a 
few cases, and it is difficult to conclude on this basis that neural network material modeling will 
take less computer time compared to other approaches. The time taken by the initial stiffness 
method using the stress-strain function from equation (2) is the smallest. In this case the func- 
tion evaluation is extremely fast because it is in a form of a simple equation. This indicates that 
in nonlinear analysis most of the time is taken in obtaining the material response. For large size 
nonlinear analysis problems, the choice of appropriate material modeling is very essential to keep 
the analysis time within reasonable limits. 

Xo further investigate the accuracy of neural net modeling with the other techniques, the 
forces in the members of the Truss3 are plotted on figures 21 to 24. The member numbering is 
shown on figure 8. The applied load was increased in five steps to the maximum value of 13.5 units. 
It can be seen that all the techniques produce results very close to the exact solution with NN 
models having a slight edge over the linear interpolation scheme. 


CONCLUSIONS 

From the results and the discussion the following conclusions can be drawn. 

1. Neural network material modeling can successfully be implemented in a general purpose 
analysis program. 

2. The neural network models provide reasonably accurate solutions to the nonlinear elas- 
tic analysis of trusses. If the network configuration is chosen with care extremely accurate 
solutions are possible. 

3. The network trained with larger input-output pairs reproduce the material behavior 
more accurately. 

4. The linear interpolation scheme for handling the material data is most commonly used 
in general purpose nonlinear finite element analysis programs. The neural networks are able to 
provide more accurate solutions in comparison to this scheme. 

5. The incorporation of neural network material modeling in an analysis program does not 
appreciably change the convergence characteristics of the initial stiffness method. 

6. It is not possible to conclude from this study that neural net material modeling will 
result in savings in computer time. It is comparable to the linear interpolation scheme. 

7. It is anticipated that in case of more complicated material models neural network 
approach will be able to provide more accurate results as compared to other schemes. 

8. Neural network offers a viable alternative for material modeling. In this approach 
material information can be captured in a small file containing weights and biases leading to sig- 
nificant data base compression. 

9. The network trained with least errors may not provide the most accurate solution to 
the analysis problems. 
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iO. More work is needed to establish guidelines for configuring an appropriate network 
model. Especially in selecting the number of hidden processing elements. At this time it is 
primarily a trial and error process. 
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TABLE I.— PREDICTED MAXIMUM LOAD CAPACITY 


OF TRUSSES 


Truss number 

Trussl 

Tru8s2 

TruBs3 

Trus84 

Manual calculations 

10.0 

21.478 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

Stress-strain function 

10.0 

21.478 

13.9 

13.3 

Neural 

1-10-1.13 

9.8 

21.478 

13.8 

13.0 

network 

1-5-1.19 

9.6 

21.478 

13.5 

12.8 

Linear interpolation 

10.0 

20.5 

13.8 

13.3 


TABLE II.— MAXIMUM DISPLACEMENTS FOR TRUSSES 


Truss number 

Tru8sl 

Truss2 

Tru8s3 

Truss4 

Applied load 

9.6 

20.5 

13.5 

12.8 

Stress-strain function 

0.799 

0.985 

2.246 

1.176 

Neural 

network 

1-10-1.13 

0.796 

0.961 

2.223 

1.127 

1-5-1.19 

0.928 

1.104 

2.444 

1.202 

Linear interpolation 

0.799 

1.085 

2.335 

1.244 


TABLE III.— COMPUTER TIME FOR THE ANALYSIS OF 
DIFFERENT TRUSSES 


Truss number 

Trussl 

Tru8s2 

TruseS 

Truss4 

Applied load 

9.6 

20.5 

13.5 

12.8 

Stress-strain function 

8.07 

15.1 

6.1 

29.4 

Neural 

network 

1-10-1.13 

16.8 

33.67 

20.65 

77.28 

1-5-1.19 

25.58 

42.18 

35.32 

113.15 

Linear interpolation 

12.52 

37.56 

13.13 

55.75 
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Fig.1 The Configuration of a Neural Network 
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Stress-strain funct + 1-5-1.19 net ^ 1-10-1.19 net 

Fig. 3 Neural Network predictions for stresses 
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Stress-strain funct + 1-5-1.19 net ^ 1-15-1.13 net 

Fig. 4 Neural Network predictions for stresses 
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- 1-5-1.13 net 1-10-1.13 net 1-15-1.13 net 

Fig. 5 Errors in Neural Net interpolations 
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1-5-1.19 net 1-10-1.19 net 

Fig.6 Errors in Neural Net interpolations 
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1-15-1.13 net 1-5-1.19 net 

Fig.7 Errors in Neural Net interpolations 
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linear elastic I manual calc. ^ initial stiffness md 

Fig. 9 Applied load vs. maximum displacement for Trussi 
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linear elastic manual calc. ^ initial stiffness md 

Fig.10 Applied load vs. maximum displacement for Truss2 
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X 1-10-1.13 neural net ■ 0 • 1-15-1.13 neural net 

Fig. 11 Applied load vs. maximum displacement for Trussi 




23 



Axial Load 


CM 



24 


^ 1-5-1.19 neural net Linear Interpolation 

Fig.13 Applied load vs. maximum displacement for Trussi 
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^ 1-5-1.19 neural net Linear Interpolation 

Fig.15 Applied load vs. maximum displacement for Truss2 
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* 1-5-1,19 neural net Q Linear Interpolation 

Fig.16 Applied load vs. maximum displacement for Truss3 
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^ 1-5-1,19 neural net ° Linear Interpolation 

Fig.17 Applied load vs. maximum displacement for Truss4 
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Fig. 18 Predicted maximum load capacity 
from different material models 
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Fig.19 Maximum displacement for trusses 
from different material models 
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Fig.20 CPU times for trusses from different material models 
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Fig.21 Compressive force in member 1 and 2 of Truss3 
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Fig.22 Compressive force in memeber 3 of Truss3 
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Fig. 23 Tensile force in member 4 of Truss3 
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Fig.24 Tensile force in member 5 of Truss3 
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